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jNTERM ET PORTAL SYSTEM AND METHOD EMPLOYING 
HANDHELD DEVICE THAT CONNECTS TO BROADCAST SOURCE 

BACKGROUND OF THE INVENTION 
5 [0001] The present invention relates generally to network-based 

portals that integrate broadcast source information with other information that 
may have been downloaded to a client device. More particularly, the invention 
relates to a client-server system for delivery of broadcast information and other 
information to a handheld device useful in interactive multimedia and interactive 

10 television applications. 

[0002] Current internet portals are designed for computer access, 

typically through a web-browser. While it is possible to download information 
about television programs from such a portal, such as in WebTV or Internet TV, 
the result is not satisfactory primarily due to that fact that either computer 

15 screen or Internet screen is intrusively interfering with the viewer watching main 
TV screen. Current technology provided by Liberate, OpenTV, Wink, Microsoft, 
IBM, Philips do not provide solutions to this problem. Further, the current 
technology integrating broadcast source and portal requires consumer to have 
an Internet connection on at all times. Future interactive television programs 

20 are likely to need better portal conductivity than is currently available. The 
present invention is designed to fill that need. 

SUMMARY OF THE INVENTION 
[0003] The present invention provides a client-server system 

25 where the server functions as an internet portal and the client is deployed on a 
handheld device. The handheld device functions to download television 
program-related contents and to upload user data for interactive television 
applications. Unlike with conventional internet access, the handheld device 
also communicates with a broadcast source (such as a television broadcast 

30 source) to automatically receive program-identifying information that is used to 
select, for example, the proper internet IP address or addresses for the 
applicable interactive functions. The program-identified information may 
consist of simple IP address information or it may comprise more complex 
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collections of data organized in a variety of different data structures including 
list data structures and nested directory data structures. These more complex 
data structures allow the user to select among different classes of requests that 
may be made of the interactive system. 
5 [0004] In accordance with the invention, several useful business 

models are supported. In one embodiment advertisers purchase space on the 
portal. Because this portal communicates with the client handheld devices, the 
subscribing advertisers are, in effect, purchasing advertising space that can be 
placed in the palm of the consumers hand. In another business model 

10 consumers subscribe to the portal services and the portal provides premium 
services and premium information through the handheld device. For a more 
complete understanding of the invention, its objects and advantages, refer to 
the remaining specification and to the accompanying drawings. 

[0005] Further areas of applicability of the present invention will 

15 become apparent from the detailed description provided hereinafter. It should 
be understood that the detailed description and specific examples, while 
indicating the preferred embodiment of the invention, are intended for purposes 
of illustration only and are not intended to limit the scope of the invention. 

20 BRIEF DESCRIPTION OF THE DRAWINGS 

[0006] Figure 1 is a block diagram illustrating an exemplary 

embodiment of a system in accordance with the invention; 

[0007] Figure 2 is a data flow diagram illustrating how messages 

are passed between client and server in accordance with the invention; 
25 [0008] Figure 3 is a data structure diagram illustrating one 

embodiment of a more complex nested directory data structure in accordance 
with the invention; 

[0009] Figure 4 is a block diagram illustrating an exemplary 

request message handling on handheld and server; 
30 [0010] Figure 5 is a block diagram illustrating an exemplary 

commerce architecture utilizing a content provider model; 
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[0011] Figure 6 is a block diagram illustrating an exemplary 

commerce architecture utilizing a direct-to-customer model; 

[0012] Figure 7 is a block diagram illustrating an exemplary 

commerce architecture utilizing a full-service- provider model; 
5 [0013] Figure 8 is a block diagram illustrating an exemplary 

commerce architecture utilizing a intermediary model; 

[0014] Figure 9 is a block diagram illustrating an exemplary 

commerce architecture utilizing a shared infrastructure model; 

[0015] Figure 10 is a block diagram illustrating an exemplary 

10 commerce architecture utilizing a value net integrator model; 

[0016] Figure 11 is a block diagram illustrating an exemplary 

commerce architecture utilizing a virtual community model; and 

[0017] Figure 12 is a block diagram illustrating an exemplary 

commerce architecture utilizing a whole-of-enterprise model. 

15 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
[0018] The following description of the preferred embodiment(s) is 

merely exemplary in nature and is in no way intended to limit the invention, its 
application, or uses. 

20 [0019] In one presently preferred form the invention defines a 

system that supplies information to a handheld device from a plurality of 
disparate sources that are pot conventionally compatible. For example, the 
system may supply information to the handheld device from a broadcast source 
of the type normally designed to deliver contents to a television. In addition to 

25 that source the system also supplies information from a packet-based delivery 
system such as a computer network or the internet. Accordingly, one 
embodiment of such a system may have been illustrated in Figure 1. Referring 
to Figure 1 , the television 10 may include a set top box 12 that receives content 
from a broadcast source 14. The set top box 12 includes a tuner and is also 

30 equipped with the ability to communicate wirelessly with the handheld device 
18. In the illustrated embodiment the handheld device 18 is a remote control 
device that may have a touch screen 20 on which the user may view 
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information and also make selections using a suitable stylus 21. The handheld 
device 18 communicates wirelessly with set top box 12 to receive information 
from the broadcast source 14. In a digital television application the information 
destined for the handheld device may be encoded within the digital data 
5 stream. In this regard, the MPEG transport stream standard provides for the 
delivery of such digital content. In an analog television application the 
information destined for the handheld device 18 may be encoded within the 
vertical blanking interval (VBI). Optical encoding technology as taught by 
4,807,031 to Broughton et al is also well known in the art. 

10 [0020] Information is also supplied to the handheld device 18 from 

another disparate source. In the embodiment illustrated in Figure 1 this 
disparate source comprises an internet-based portal. As illustrated, a server 22 
which is operating the portal server software module 23 communicates with the 
internet 24. A suitable gateway device 26 is coupled to the internet and 

15 provides wireless connectivity with the handheld device. This way packet- 
delivered information is supplied to the handheld device 18. 

[0021] Although the principles of the invention may be extended 

to a wide variety of different applications, Figure 1 illustrates a particularly 
useful application in implementing interactive television features that are not 

20 typically found in other systems. The handheld device may have internal 
memory that is configured as a local data store 30 into which a local copy of 
selected electronic program guide (EPG) information may be stored. Typically, 
the EPG information is available from the broadcast source 14 in at least a 
basic channel-time-program content format. While the available bandwidth 

25 within a digital broadcast source is sufficient to deliver more information than 
the simple EPG data described above, current analog broadcast sources have 
limited bandwidth for such information and are thus typically restricted to very 
simple EPG data content, if any. The present invention overcomes this 
limitation by utilizing additional information obtained from the internet (or from 

30 some other source disparate from the broadcast source). The information 
received from the broadcast source and from the other source (e.g., server 22) 



4 



WO 03/088544 



PCTAJS03/09881 



is integrated and used by a client application program 32 running on the 
handheld device 18. 

[0022] Figure 2 shows how the client and server interact with one 

another to provide interactive functionality. Specifically, Figure 2 shows the 
5 client 32 in communication with server 22. The flow of messages may have 
been labeled by the circled sequence numbers. Note that the client 32 may 
have locally stored knowledge of basic EPG information contained within data 
store 30. 

[0023] Referring to Figure 2 and proceeding first from left to right, 

10 the user of the handheld device enters a series of requests into the handheld 
device. These requests may be of different types at different times. When a 
network connection is not available, these requests are made off-line, stored 
and queued locally on the handheld. Illustrated here are three different request 
types. Request_001 records the user's vote in response to a query or selection 

15 being offered via the broadcast source 14. The offering may be viewed on the 
television 10 or on the display screen 20 of the handheld device. Request_002 
corresponds to a user's request to download a particular selection of additional 
media content such as an MP3 audio file from the server. Request_003 
corresponds to an e-commerce transaction, such as an order placement. 

20 [0024] When the network connection to the portal is available, the 

requests are processed by the client application 32 and then transmitted using 
the network protocol such as TCP/IP over the internet (not shown) to server 22. 
It will be. appreciated that while the internet presently represents the most 
convenient mechanism for delivery of packet-based content, other types of 

25 networks may also be employed to connect client with server, if desired. 

[0025] The server 22 processes the request messages sent to it 

by the client 32 as illustrated at 50. It associates each of the requests with a 
different IP address, based on criteria such as the request type, the IP address 
of the client 32, other user-identifying information obtained from client 32 or 

30 from some other server, date and time information, and/or combinations 
thereof. In the illustrated embodiment of Figure 2 the request type is used to 
assign the IP address to each request. Server 22 then passes the respective 
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requests to their respective IP addresses where responses are generated as 
illustrated diagrammatically at 52. These responses are then sent by server 22 
(or by other servers in receipt of the requests from server 22) back to client 32 
as TCP/IP encoded packets. 
5 [0026] Figure 2 thus illustrates how different types of requests 

may be divided up at the server and delivered to different systems for 
processing. In the illustrated embodiment, a server at IP address 
192.168.1.123 receives the user's vote and sends back the vote result. The 
server at 192.168.1.128 handles the user's request for an MP3 file. Similarly, 

10 the server at 192.168.1.125 processes the user's e^commerce order and sends 
back an order confirmation. 

[0027] Even more sophisticated message processing may be 

effected by taking into account other information such as the identity of the user 
and/or date and time information. For example, when the system is used to 

15 deliver advertising content via the handheld device, the advertising content may 
be tailored to different geographic regions based on user-identifying 
information, the user's gateway IP address, and/or global positioning system 
(GPS) functionality of the handheld device. Date and time information may be 
used to control advertising content as well. For example, certain content may 

20 be restricted to certain times of day when young children are less likely to be 
watching, or certain content may be modified depending on the day to 
correspond with local store sale schedules. 

[0028] Figure 4 shows a presently preferred nested data structure 

for embodying the aforesaid more sophisticated message processing. Figure 3 

25 shows a presently preferred block diagram for handling these request data at 
both handheld and server ends. As illustrated in Figure 3A, where the network 
connection may not be available, handheld application 72 generates internet 
portal requests 74, the system stores and queues these request on the 
handheld device 76. The handheld device is also running a daemon that 

30 constantly checks for the Internet connection 54 to the server. As soon as this 
connection is established 56, stored requests will be sent to the portal for 
processing 70, receive acknowledgement from the server on the current 
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request 78, update the status of the request 80 and notify user 82 through GUI 
applications. 

[0029] In reference to Figure 3B, on the server side, the system 

checks incoming requests 84 from the client. Once incoming request is 
5 received, the server parses request 86 and send acknowledgement 88 to the 
client based on the header information in the request. An example of header 
information includes client ID and network address the request 
acknowledgement and contents need to be sent to. The server continues to 
fulfill requests and retrieve requested contents 90. The requested contents may 

10 be retrieved from local storage on the server or a 3 rd party content provider 92 if 
necessary. The retrieved contents are packed 94 and send to the client 96. 

[0030] In continuing reference to Figure 3A, once network 

connection is available and requests are pending, the handheld continuously 
check incoming return message 58 and retrieve returned content packages 60 

15 from the server. Upon the receiving of requested contents, the system unpack 
the contents 62, parse returned contents for, request ID 64. Returned contents 
will also be parsed and associated with the identified request ID. Then and 
request status will be updated 66 and notified to the user 68 through GUI 
applications. 

20 [0031] The internet portal system of the invention may be 

architected in a variety of different ways to achieve different business goals. 
Figures 5-12 illustrate several of these, in each architectural model the 
broadcast source and server source work together to place interactive 
capabilities into the user's hand that have not heretofore been achieved. Each 

25 of these architecture models affords opportunities for improving message 
delivery and viewer attention, thereby improving viewership ratings, allowing e- 
commerce opportunities, and increasing advertising revenues for the content 
suppliers. 

[0032] In each of Figures 5-12, the end user or users receive 

30 information from a broadcast source 14 and also from a portal 23 in 
accordance with the invention. Figures 5-12 illustrate different ways of utilizing 
the portal to effect different forms of commerce. 
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[0033] Figure 5 shows a content provider commerce model in 

which the portal 23 functions as an intermediary service provider. The 
intermediary service provider obtains content from the content provider and 
supplies this content to the end user via the handheld device. 
5 [0034] Figure 6 shows a direct-to-customer commerce model in 

which the portal 23 serves as the primary supplier of goods and services to the 
end user via the handheld device. 

[0035] Figure 7 illustrates a full service provider commerce model 

in which the portal 23 provides a plurality of different related or unrelated 
10 services to the end user via the handheld device. Portal 23 communicates with 
a plurality of different sponsors and suppliers by which sponsoring content 
"material and third party goods and services are obtained and delivered to the 
end user. 

[0036] Figure 8 illustrates the use of the portal in an intermediary 

15 commerce model configuration. In this case, an intermediary portal 23a 
cooperates with an ally portal 23b. The intermediary portal receives content 
from third party sellers and advertisers, which may also pay the intermediary 
money as fees for providing the portal service. The intermediary portal delivers 
information to the end users either directly or through the ally portal 23b via the 

20 handheld device. The end users may then transact business either through the 
intermediary portal 23a or directly with the third party sellers. 

[0037] Figure 9 illustrates a shared infrastructure commerce 

model in which a plurality of suppliers and infrastructure owners cooperate by 
providing product information to a shared infrastructure portal 23. Customers 

25 communicate with the portal 23 via the handheld device to purchase goods and 
services from the suppliers and owners. If desired, ally portals may also be 
utilized to effect commerce between customer and owner (or supplier) and 
between customer and the shared infrastructure portal. 

[0038] Figure 10 illustrates a commerce architecture utilizing a 

30 value net integrator model as portal 23. The value net integrator assists in 
managing the businesses of the franchisees by communicating with suppliers 
to ensure that needed products are developed, supplied, and delivered to the 
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franchisees. The integrator also ensures that advertising and related services 
are provided in the form of the broadcast source in a manner that allows 
customers having suitably equipped handheld devices to interact with the 
franchisees via the handheld devices. 
5 [0039] Figure 1 1 illustrates a virtual community commerce model 

to which a plurality of members may belong or subscribe. The virtual 
community serves as a portal 23 to which suppliers may communicate 
information about products and services offered. Members access the virtual 
community portal 23 via the handheld device to exchange information and to 

1 0 transact business with the suppliers. 

[0040] Figure 12 illustrates a whole-of-enterprise commerce 

model that is designed to encapsulate a plurality of functions offered by 
different business units of an enterprise. The portal server 23 communicates 
with these business units and makes information about each business unit's 

15 products and services available to users via the handheld device. Of course, if 
desired, the users may access the sites of the business units directly, as 
illustrated by the lines connecting User 1 and Business Unit A and between 
User 3 and Business Unit C. 

[0041] The description of the invention is merely exemplary in 

20 nature and, thus, variations that do not depart from the gist of the invention are 
intended to be within the scope of the invention. Such variations are not to be 
regarded as a departure from the spirit and scope of the invention. 
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